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Abstract — Lossy transmission over a relay channel in which 
the relay has access to correlated side information is consid- 
ered. First, a joint source-channel decode-and-forward scheme is 
proposed for general discrete memoryless sources and channels. 
Then the Gaussian relay channel where the source and the side 
information are jointly Gaussian is analyzed. For this Gaussian 
model, several new source-channel cooperation schemes are 
introduced and analyzed in terms of the squared-error distortion 
at the destination. A comparison of the proposed upper bounds 
with the cut-set lower bound is given, and it is seen that joint 
source-channel cooperation improves the reconstruction quality 
significantly. Moreover, the performance of the joint code is close 
to the lower bound on distortion for a wide range of source and 
channel parameters. 

I. Introduction 

In many sensor network applications, the goal is to obtain 
a high fidelity reconstruction of an underlying physical phe- 
nomenon at the access point. While sensors might each try to 
send their own observations directly to the access point, this 
might result in poor reconstruction quality due to the power 
limitations of the sensor nodes. Cooperative transmission, in 
which the nearby nodes help each other's transmissions, has 
been analyzed extensively in the literature as a promising 
technique to overcome the power limitation [1], [2]. However, 
in many sensor network applications, the sensor observations 
are highly correlated. It is natural to exploit correlated source 
coding together with cooperative communication, and this 
might lead to better reconstruction at the access point than 
using these two techniques independently. Finding the optimal 
strategy in terms of the end-to-end reconstruction fidelity in 
a general network is a very difficult problem. In fact, we 
do not even know the necessary and sufficient conditions 
for lossless transmission over simple network components 
such as multiple access or broadcast channels with correlated 
sources [3], [4]. There are some special cases for which the 
optimal performance has been characterized [5] -[7]. However, 
it is likely that the optimal performance requires joint source- 
channel coding (e.g. [7], [8]), as Shannon's source-channel 
separation theorem does not apply to multi-terminal scenarios 
in general. 
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In this paper, we consider cooperative transmission in which 
the relay has correlated side information. The goal is to recon- 
struct the observation of the source terminal at the destination 
with the least possible distortion. In this scenario, the relay 
terminal can help the source by both improving the channel 
transmission rates and by reducing the source compression 
distortion. In general, the problem is a joint source-channel 
coding problem, and characterization of the necessary and 
sufficient conditions is an open problem. We considered this 
problem for lossless transmission in [6] and gave the necessary 
and sufficient conditions for some special cases. In [9], we 
focused on the Gaussian relay channel with quadratic Gaussian 
sources, and provided achievable schemes and comparisons 
with the joint source-channel cut-set bound. The proposed joint 
source-channel relaying schemes in [9] are grouped into three 
types. In the first group, called channel cooperation, the relay 
simply ignores its side information, and applies one of the 
well-known cooperative transmission schemes such as decode- 
and-forward (DF) or compress-and-forward (CF) [1]. In the 
second group, called source cooperation, the relay ignores its 
received signal and uses only its side information either by 
uncoded transmission followed by MMSE estimation at the 
decoder, or by a separation-based scheme in which the source 
and the relay first compress their sources at rates specified 
by one-helper source coding problem [11] and then transmit 
the compressed information separately by multiple access 
channel coding [9]. Finally, in the third group, called hybrid 
cooperation, the relay sends a superposition of channel and 
source cooperation codewords by a suitable power allocation. 
It is shown in [9] that hybrid cooperation performs better than 
either of the other two types, and approaches the cut-set lower 
bound closely for various source-channel settings. 

In this paper, we extend the results of [9] by using the 
techniques of [6], which were originally developed for lossless 
transmission. Specifically, we propose a joint source-channel 
decode-and-forward (jDF) scheme for discrete memoryless 
sources and channels. In jDF, the relay uses its side infor- 
mation to improve the relay transmission rates through a 
joint source-channel coding technique. The results are then 
generalized to the Gaussian case. In addition to jDF, for the 
Gaussian case, we propose a joint source-channel partial DF 
protocol as well as a hybrid version of jDF, in which the 
relay cooperates for both source compression and channel 
transmission. Then we propose a generalized source-channel 



cooperation protocol combining all of the above techniques, 
which reduces to the previous protocols as special cases. 
We compare the squared-error distortion achieved by the 
proposed schemes and the cut-set lower bound for various 
source-channel parameters. Compared to the classical DF 
scheme, jDF improves the end-to-end distortion significantly, 
especially when the relay side information quality is high. 
Further improvement is obtained with the generalized protocol 
which dominates the other known schemes for a wide range 
of source-channel parameters. 

II. System Model 

In this section, we introduce the system model for discrete 
memoryless (d.m.) sources and d.m. channels with a general 
distortion measure and input cost constraint. Later in Section 
IIVI we concentrate on the Gaussian source and channel case 
and provide a comparison of the proposed schemes for this 
case. Let {Si } k, S2,k, S3 } k}kLi be a sequence of independent 
drawings of the correlated random variables Si, S2 and S3 
having joint distribution -PS1S2S3 on the set Si x S2 x S3. 

The source Si is to be transmitted over a discrete memo- 
ryless relay channel specified by the conditional distribution 
Pyy± IX1X2 over tn e set X± x X% x ^i x y, where X±,X 2 are 
the input alphabets for the source and the relay, respectively, 
and yx,y are the relay and the destination output alphabets, 
respectively. The relay terminal has access to the correlated 
side information S2, and the destination has access to the 
side information S3. The goal is to reproduce Si at the 
destination according to the single letter distortion measure 
d : Si X Si — > [0, 00). 

The source encoder observes S™ = (Si,i, . . . ,Si. m ) and 
maps it to the transmitted codeword X" = (Xxi, ...,Xx !n ) 
using a joint source-channel encoding function f( m ' n \ At 
time instant k, the received signals at the relay and the 
destination are Y\ t u and Y k , respectively. The relay encoder 

(/ 2 ( ™'"\ • • • > /i™'""*) where we have X 2 , k = 
■ ■ ■ , Yi,fc-i, S^), for 1 < k < n. We denote by 
b = n/m the rate of the code. 

We assume separate cost constraints Y\, T2 at the source 
and the relay, respectively. The average cost function is given 
as 7i(Xf ) = i YJj = i li( x i,j)< where 7 : X t -> [0, 00) is the 
cost of the input signal for i — 1,2. The destination decoder 
observes the received vector Y n = (Yi, . . . , Y n ) and its own 
correlated side information S3 1 and outputs its estimate of 
the source Sf = (S M , . . . , Si, m ) = g ( m >™)(Y n , Sf), where 

g{m,n) . yn x gm _^ gm j § mg recons t rU Ction function. 

Definition 2.1 : For given (b, Fi,!^), we say that the av- 
erage distortion D is achievable if, for any e > 0, there 
exist sufficiently large m,n with n/m = b, and encoding 
and decoding functions (fi' n \ f( m ' n \ g( m > n )') satisfying the 

1 < r„ fori = 1,2, while 



is f 2 

f (m,n) 



input cost constraints E 
the average distortion is 



bounded as 



The minimum achievable distortion D m i n for given 
(6, ri,r2) is defined as D m i n = vai{D : D is achievable}. 
We want to find D m i n for a given source-channel model. In 
this paper, we provide upper and lower bounds on D m i n . 

III. Joint Source-Channel Decode-and-Forward 
(jDF) 

This scheme is based on the well-known decode-and- 
forward relaying scheme; however, we use the side information 
at the relay to achieve higher rates over the source-relay 
channel. We use a joint source-channel relaying technique [6] 
which was introduced for lossless transmission of a source 
over the relay channel with correlated relay and destination 
side information. In the lossy case, the source terminal encoder 
generates a quantization of the source Si based on an auxiliary 
random variable Z satisfying the Markov chain relationship 
Z — Si — (S2, S3), and transmits a codeword to the destination 
with the help of the relay. For transmission, we use block 
Markov encoding. At the destination backward decoding spe- 
cialized to this joint source-channel coding is used. We have 
the following achievability result for the lossy scenario, which 
we give without proof due to lack of space. We refer the reader 
to [6] for the details of the scheme. 

Theorem 3.1: Given a relay channel p(y, y\\xi, X2) and 
source and side information with joint distribution ps 1 s 2 S 3 , 
then distortion D with respect to some distortion measure 
d(-, •) is achievable for a given triplet (b, Ti, T2) if there exists 
an auxiliary random variable Z and input distributions Px x 
and Px 2 at the source and the relay, respectively, satisfying 
the following conditions: 

1) Z — Si — (S 2 , S 3 ) form a Markov chain, 

2) E[d(S\, h(Z, S3))] < D for some reconstruction func- 
tion h : Z m x S3™ -> Sf , and 

3) Xi satisfy the input cost constraints E[y(Xi)] < Ti, 
4) 

I(S 1 ;Z\S 2 )<bI{X 1 ;Y 1 \X 2 ), and (2) 
I(S 1 ;Z\S 3 )<bI(X 1 ,X 2 ;Y), (3) 

where p(si, s 2 , s 3 , z, x\, x 2 , yi,y) = p(si, s 2 , s 3 )p(z\si) 
p(xi,X2)p(yi,y\xi,X2), and the cardinality bound \Z\ < 
I Si I +2 is satisfied. 

IV. The Quadratic Gaussian Case 

Here we focus on the quadratic Gaussian problem, in which 
the source and the side information are jointly Gaussian while 
the channel is an additive white Gaussian noise (AWGN) chan- 
nel. For clarity of presentation, we assume that the destination 
does not have side information, i.e., S3 = 0, although our 
achievability schemes can be extended to the case with side 
information as well. Without loss of generality, we assume 
that the sequences {Si,j} and {S2,i} are independent and 
identically distributed (i.i.d.), zero mean and jointly Gaussian 
with covariance 



1 



-E 



}^d(Sx,i,Si,i) 



< D 



(1) 



S1S2 



1 P 
P 1 



(4) 



Zi ~ JV(0, «i) 







Relay 

(R) 


X, 


r 







Sv 



Source X\ 
(S) 



v Y 



Z ~ N(0. N) 



Destination 
(D) 



■Si 



Fig. 1. Gaussian relay channel with correlated sources (Si, S2) at the source 
(S) and the relay (R) terminals. 



where p E [—1,1] is the correlation coefficient. The distortion 
is measured by the squared error distortion measure d(s, s) = 
(s — s) 2 . The channel is represented as follows: 

Y hk = h 2 X hk + Z hk , (5) 

Y k = hiXi, k + h 3 X 2 ,k + Z k , (6) 

for k = 1, . . . , n, where Z? = (Z ltl , Z hn ) and Z n = 
(Zi, . . . , Z n ) are i.i.d. zero-mean Gaussian noise vectors with 
variances Ni and N, respectively, and are independent of X™, 
X 2 and each other. The input cost is measured by the power 
of the channel input ji(x) = x 2 , and we set T,; = Pi, i = 1,2. 
Without loss of generality, we assume \hi\ 2 = 1, and define 
\h 2 \ 2 = a and \h 3 \ 2 = (3 and let N = /Vi = 1 (see Fig. [Q. 
We assume one channel use per source sample, i.e., 6=1. 

The joint source-channel cut-set lower bound [12] in the 
quadratic Gaussian case is given as [9]: 

D mm > ^maxlfl - p 2 )(l + (1 - C 2 )(l + a)Pi)- 1 , 



in which ^ is the correlation coefficient between the source 
and the relay codewords. 

A. Joint Source-Channel Decode-and-Forward (jDF) 

Using Theorem 13. II a quantization of the source S\ is trans- 
mitted to the destination using an auxiliary source codebook 
Z. Let Z = Si + W, where Si _L W and W - W(0, a^). 
Then we have 



I(Si;Z\S 2 )=llog(l + K£- 



ir 



, and 



J(S i; Z)=ilog(l + 4- 



(7) 



(8) 



We also have 



7(Jfi;yi|JT 2 ) =- log(l + (1 - C 2 )aPi), and 

/(Xx, X 2 ; Y) =i log(l + Pi + /3P 2 + 2MPP 1 P 2 ), (9) 

where, as before, £ is the correlation coefficient between the 
channel inputs Xi and X 2 . For given Pi , P 2 and fixed £, the 
minimum quantization noise variance is given by 



a w =max 



l-p 2 1 



(1 - e)aPi ' Pi + I3P 2 + 2ZVW\P2 



and by minimizing over £ the minimum distortion is found as 

D jDF =min < ? <i T ^-. 

B. Hybrid Joint Source-Channel Decode-and-Forward 

In the hybrid joint source-channel DF (hjDF) protocol, the 
relay divides its power between sending its observation to 
the destination directly (source cooperation) [9] and the joint 
source-channel DF protocol. It then transmits a superposition 
of the two codewords obtained using the two strategies. Sup- 
pose the relay reserves 7P2 (0 < 7 < 1) for the jDF protocol 
above, and (1— 7) Pa for transmitting a quantized version of S 2 
to the destination. The destination first decodes the quantized 
5*2, treating the jDF codeword as noise. Then for jDF, this 
quantized S2 can be used as side information at the destination. 
Finally, the destination combines the side information received 
from the relay and the information received from the jDF 
codeword to obtain a reproduction of the source. 

Let Z h = S 2 + V, where S 2 _L V and V - Af(0, a 2 ,). The 
rate at which the relay can send Zh is 



P fe (7) = Wl + /3(1 ' 7)P2 
U) 2 S V l + Pi+l3 1 P 2 



Then we have 



1 + Pi + /3 7 P 2 



(10) 



(ID 



0(1- j)P 2 • 

For jDF, we set Z = Si + Wi with Si _L Wi and Wi ~ 
7^(0,0-^) in TheoremO We need to have I(Si;Z\S 2 ) < 
I(Xi;Yi\X 2 ) and I(Si;Z\Z h ) < I(Xi,X 2 ;Y), where X 2 is 
the codeword of the relay forwarding Zh- We have 



I {Si; Z\Z h ) = \\og[ I 



I-P 2 



(12) 



°wS l + ° 2 v). 

Other mutual information expressions can be calculated as 
in Section HV-AI by replacing P2 with 7P2. For fixed £, the 
minimum quantization noise is found as 
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and the minimum distortion for hjDFh is found as 
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C. Joint Source-Channel Partial DF 

In the partial decode-and -forward protocol [1], only a por- 
tion of the source message is transmitted using the relay, while 
the rest is transmitted directly from the source. It is shown in 
[13] that, for AWGN channels the partial DF protocol picks the 
best protocol between direct transmission (DT) and decode- 
and-forward (DF), but does not improve the achievable rate of 
DF. However, as we will show, in the presence of correlated 
side information at the relay terminal, partial joint source- 
channel DF (pjDF) has the potential for achieving lower 
distortion. 



S-D=5dB, R-D=10dB 



S-D =5 dB , R-D =10 dB, p=0.6 



DT 

CF 

- • -jDF,p=.3 

- ♦ -]DF,p=.9 

— • — Lower bound, p=.3 
— Lower bound, p- 




5 10 15 

Average SNR for S-R link (dB) 

Fig. 2. Comparison of pure channel cooperation protocols DF and CF, which 
ignore the side information at the relay, with jDF for low and high quality 
side information. 



In pjDF, the source terminal divides its power into two 
portions. It uses BP\ of its power for jDF as in Section 
IIV-BI while the rest is used for direct transmission. The two 
codewords are superimposed. As in partial DF [1], first the 
jDF portion is decoded by treating the direct transmission as 
noise. For jDF, the source transmits Z 2 = Si + Wi + W 2 to 
the destination, where W\ and W 2 are independent Gaussian 
random variables with Si _L (Wi,W 2 ), W\ ~ A/"(0, rr^) 
and W 2 ~ A/"(0, <7j^ 2 ). It can be shown that, for fixed £, the 
minimum quantization noise variance for Z 2 is 

P 2 )(l 



'Wi 



&W2 - max 



1 



a 1 



)Pi) 



(i - ehePi 

1 + (1 - 0)P 1 



(13) 



For direct transmission, the source transmits Si + W\ utilizing 
the side information at the destination. Note that the relayed 
signal is subtracted before decoding the direct information. We 



need I (Si; 
We have 



Si + W 1 \Si + Wi + W 2 ) < l/21og(l + (l-0)Pi)). 



I(Sx;Si + Wi\Si + Wi + W 2 
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The minimum distortion is found as Dj p rjF = 
min o <0, ? <i l^i . 



In contrast to the transmission rate of partial DF in AWGN 
channels, as will be seen in Section [V] for certain scenarios 
pjDF strictly improves the distortion performance relative to 
both direct transmission and jDF. 

D. Hybrid Partial jDF 

We also consider a hybrid version of the above partial jDF 
scheme where both the source and the relay partition their 
power, and each terminal uses a portion of its power for direct 
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Fig. 3. Average distortion vs. S-R link quality. 



transmission of its source samples. The remaining power at the 
source and the relay is used for cooperation through the jDF 
protocol. We call this scheme hybrid partial jDF (hpjDF). The 
minimum distortion expression for this scheme can be derived 
as in the previous subsections. 

V. Comparison and Discussion of the results 

In this section, we compare the average distortion achieved 
by the strategies in Section [IV] For various source and channel 
conditions we also provide comparisons with [9]. We assume 
a\ = 1 and measure the S—R, S — D and R—D link qualities 
by Pi, aPi and (3P 2 , respectively. 

We first analyze the improvement of jDF over the well- 
known channel cooperation schemes DF and compress-and- 
forward (CF), where the relay side information is ignored. We 
set S - D and R-D link qualities to 5 dB and 10 dB, 
respectively. We see in Fig. |2] that, as expected, jDF improves 
upon the usual DF even with very low quality relay side 
information, i.e. for p = 0.3. As the side information quality 
increases, i.e., for p — 0.9, jDF outperforms both DF and CF, 
at all channel conditions under consideration. CF performs 
better than DF when the S — R quality is low. 

Next, in Fig. [3] we compare the different joint source- 
channel cooperation schemes introduced in Section HV] We set 
S—D and R—D link qualities to 5 dB and 10 dB, respectively 
and the correlation coefficient to p = 0.5. Note that pjDF 
improves upon jDF when the S-R link quality is below the 
S—D link quality. On the other hand hjDF improves upon 
jDF for a wide range of S-R link SNR's. This improvement 
increases with the quality of side information, p, as sending 
this high quality side information to the destination further 
helps the reconstruction at the destination. We also include 
the advanced CF (aCF) protocol, introduced in [9], in the 
plot as well. This is the best CF-based protocol where private 
information from the source to relay is sent to improve the 
relay's helper quality while the relay uses both source and 
channel cooperation through the hybrid strategy. We observe 
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Fig. 4. Average distortion vs. R-D link quality. 

that aCF outperforms other protocols when the S — R quality 
is relatively low, but jDF-based schemes surpass aCF with 
increasing S — R quality. hpjDF performs very close to aCF 
even when the S-R link is weak, and the gap between the 
upper an lower bounds tightens with increasing S — R quality. 

Next, we fix both S-D and S-R SNRs at dB, and consider 
high quality side information (p = 0.9). Along with hpjDF 
we also plot aCF and source cooperation, in which we ignore 
the received signal at the relay and choose the best among 
uncoded transmission and a separation based scheme detailed 
in [9]. In Fig. |4j we see that source cooperation performs much 
better than aCF for low R-D qualities. Due to high correlation 
and a relatively weak S-R link, it is more important to transmit 
relay's side information to the destination. hpjDF outperforms 
all other protocols up to large R-D SNR values, after which 
aCF starts to dominate. This is in accordance with the fact that 
the CF strategy performs better than DF in terms of achievable 
rates as the S-R link becomes the bottleneck for DF [2]. 

Finally, we fix the average received SNRs for S-D, S-R 
and R-D links at 4, 10 and 4 dB, respectively, and compare 
achievable distortions for increasing side information quality 
at the relay. For low values of p values, aCF performs better 
than the other protocols. This is due to the relatively high 
quality of the R-D link which favors CF transmission as seen 
in Fig. 2] as well. However, with increasing side information 
quality, both pure source cooperation and hpjDF outperform 
aCF. Note that, with even p = 1, i.e., when the relay has the 
exact source information, aCF falls short of the lower bound 
as it does not utilize its side information for beamforming to 
the destination as the DF based schemes. 

VI. Conclusion 

We have considered joint source-channel coding over the 
relay channel in the presence of correlated side information at 
the relay and the destination terminals. We have proposed a 
joint source-channel decode-and-forward (jDF) protocol which 
improves upon the usual decode-and-forward scheme by using 
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Fig. 5. Average distortion vs. correlation coefficient (p) for fixed links. 

the correlated side information at the relay. Then we have 
considered the Gaussian relay channel with jointly Gaussian 
source and relay side information and analyzed the achievable 
squared-error distortion at the destination. We have proposed 
a hybrid partial jDF protocol where the relay allocates its 
power between sending helper information and jDF while the 
source allocates its power between direct transmission and 
jDF. Currently, we are generalizing our joint source-channel 
relaying scheme to incorporate compress and forward [1] type 
forwarding at the relay as well. 
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